Video2Flink: real-time video partitioning in Apache Flink and the cloud

نویسندگان

چکیده

Abstract Video2Flink is a distributed highly scalable video processing system for bounded (i.e., stored) or unbounded continuous) and real-time streams with the same efficiency. It shows how complicated tasks can be expressed executed as pipelined data flows on Apache Flink, an open-source stream platform. uses Kafka to facilitate machine-to-machine (m2m) communication between production that runs Flink. Features make combination of Flink desirable solution problem are ease customization, portability, scalability, fault tolerance. The application deployed cluster worker machines run Kubernetes in Google Cloud Platform. experimental results support our claims speed showing excellent speed-up all tested resolutions. highest more than seven times) was observed videos resolutions real time.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Approximate Stream Analytics in Apache Flink and Apache Spark Streaming

Approximate computing aims for efficient execution of workflows where an approximate output is sufficient instead of the exact output. The idea behind approximate computing is to compute over a representative sample instead of the entire input dataset. Thus, approximate computing — based on the chosen sample size — can make a systematic trade-off between the output accuracy and computation effi...

متن کامل

State Management in Apache Flink®: Consistent Stateful Distributed Stream Processing

Stream processors are emerging in industry as an apparatus that drives analytical but also mission critical services handling the core of persistent application logic. Thus, apart from scalability and low-latency, a rising system need is first-class support for application state together with strong consistency guarantees, and adaptivity to cluster reconfigurations, software patches and partial...

متن کامل

Reproducible Experiments for Comparing Apache Flink and Apache Spark on Public Clouds

Big data processing is a hot topic in today’s computer science world. There is a significant demand for analysing big data to satisfy many requirements of many industries. Emergence of the Kappa architecture created a strong requirement for a highly capable and efficient data processing engine. Therefore data processing engines such as Apache Flink and Apache Spark emerged in open source world ...

متن کامل

Development of a News Recommender System based on Apache Flink

The amount of data on the web is constantly growing. The separation of relevant from less important information is a challenging task. Due to the huge amount of data available in the World Wide Web, the processing cannot be done manually. Software components are needed that learn the user preferences and support users in finding the relevant information. In this work we present our recommender ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Machine Vision and Applications

سال: 2023

ISSN: ['1432-1769', '0932-8092']

DOI: https://doi.org/10.1007/s00138-023-01391-5